
IMAGE DISPLAY METHOD, APPARATUS AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field of tfre Invention 

The present invention relates to an image display method, 
apparatus and storage medium, and more particularly to an image 
display method wherein a plurality of images are displayed on 
a CRT, LCD, etc. monitor according to a predetermined display 
layout, apparatus, and a computer - readable storage medium on 
which a program that causes a computer to execute the steps of 
the image processing method. 

Description of the Related Art 

There are in use in the medical field today apparatus 
(modalities) for forming X-ray and other diagnostic images used 
in a variety of diagnosis, including CR (computed Radiography) 
apparatus, CT (Computerized Tomography) apparatus, MRI (Medical 
Resonance Imagery) apparatus, etc. The image data produced in 
each modality is displayed on a CRT terminal (hereinafter 
referred to simply as a CRT) , or output by a laser printer, etc. 
to film, etc. for use by a reader at a medical treatment site 
in ascertaining the presence or absence of a disease, tissue 
damage , etc . 

In order to make images obtained by such modalities easy 
to use in diagnosis, it is necessary to display the images on 
a display means. At any rate, because a plurality of images are 
obtained in a single examination employing CT apparatus, MRI 



apparatus, etc. , to provide for easy examination of such images 
it is necessary to line them up. In addition, when employing 
in diagnosis images obtained by CT apparatus, there are cases 
for which images acquired in the past are compared to images 
5 acquired in the present in a comparative diagnosis, and to 
facilitate easy performance of such comparison diagnosis it is 
necessary to line the images up and display them. 

To this end, a display protocol is employed for defining 
O the display format in which a plurality of images is to be 

N 10 displayed, and based on this display protocol; the plurality 
~2 of images is displayed on the display means . The display protocol 

""^ defines the layout of a plurality of images, the display 

conditions (for example, in what order images are to be displayed, 

O 

etc.), the image processing conditions (hereinafter referred 
*Z 15 to as the layout, etc.); based on the examination, the series, 
" the examining doctor or group of doctors, the place where the 

images are to be employed, the purpose for which the images are 
to be used, etc. For example, a given display protocol might 
be defined so that a screen is divided into four regions in which 
20 are displayed: in the upper left region, a front view X-ray image 
of the chest taken during the current examination; in the lower 
left region, a front view X-ray image of the chest taken in the 
past; in the upper right region, a side view X-ray image of the 
chest taken during the current examination; and in the upper 
25 right region, a side view X-ray image of the chest taken in the 
past. In addition, another display protocol might be defined 
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so that a screen is divided into 9 regions in which a plurality 
of Tomography images obtained by a CT apparatus are lined up 
and displayed. 

Further, although a display protocol is not employed, a 
method has been provide wherein each series (by type of 
examination) of images obtained in an examination employing MRI 
apparatus is lined up and displayed, and at the same time one 
series of images is switched, another series of images is also 
switched (refer to US Patent No. 5,452,416) . According to this 
method, the examiner of images encounters no impediments in 
viewing of the images, and multiple series of images can be 
assigned to correspond to each other and displayed. 

As examinations become more complex and the number of 
images increases, if only one display protocol is defined, it 
becomes difficult to display the images so that diagnosis can 
be performed without difficulty. Because of this, a plurality 
of display protocols is prepared, and the examiner switches the 
protocols in order, so that the plurality of images is displayed 
in the desired display layout. However, in this method of 
switching protocols a great burden is placed on the examiner 
in that he or she must memorize the type of layout defined by 
each display protocol. In addition, because it is necessary to 
specify the display protocol each time the layout is switched, 
the efficiency of displaying the images is extraordinarily low. 

SUMMARY OF THE INVENTION 

The present invention has been developed in consideration 



of the circumstances described above. A main objective of the 
present invention is to provide an image display method, 
apparatus and computer readable storage medium on which a program 
that causes a computer to execute the image display method is 
recorded, which can display with high efficiency a plurality 
of images. 

In the image display method of the present invention for 
displaying a plurality of images on a display means, the display 
layout is switched by switching the display protocols, based 
on at least one display protocol sequence in which a plurality 
of display protocols that define a display layout are lined up 
in a predetermined order, and the plurality of images are 
displayed on the display means. 

The expression "display means" refers to a CRT, LCD, etc 
monitor for displaying images. 

The expression "display protocol" refers the protocol 
wnich defines image layout, image display conditions, image 
processing conditions, etc., based on an examination, a series, 
the examining doctqr or group of doctors, the place an image 
will be used and/or che purpose of the image, etc. More 
specifically, a definition by which a screen is divided into 
four regions in which are displayed a front view X-ray image 
of the chest taken during the current examination in the upper 
left region, a front view^-ray image of the chest taken in the 
past in the lower left regVon, a side view X-ray image of the 
chest taken during the current examination in the upper right 



region, and a side view X-ray image of the chest taken in the 
past in the upper sight region, or alternatively, a definition 
by which a screen is\divided into 9 regions in which a plurality 
of Tomography images obtained by a CT apparatus are lined up 
5 and displayed, or a definition by which projection images and 
cross - sectional imaged obtained by a CT apparatus are lined up 
and displayed, or a definition by which cross - sec tional images 
obtained by a CT apparatus are able to be switched and displayed, 
or a definition by which\for images Tl and T2 obtained by an 
10 MRI apparatus in a specialX examination mode, a display screen 
may be dived up and images Ndisplayed based on whether or not 
a contrast medium was used wlran an image was taken, etc., may 
be employed as display protocols. 
I* The expression "display protocol sequence" refers to an 

IZ 15 array of display protocols lined up in a predetermined order. 
fS=s Note that the display protocols in a display protocol sequence 

are lined up in an order according to the examination, the series, 
the examining doctor or the group of doctors the examining doctor 
belongs to, etc. 

20 Moreover, switching of display protocols may be carried 

out manually or automatically. 

Note that there may be only one display protocol sequence, 

however, for cases in which there are multiple display protocol 

sequences, it is desirable that it is possible to select one 
25 display protocol from said multiple protocols, and to have the 

plurality of images displayed on the display means based on the 
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selected display protocol sequence. 

In addition, when there are multiple display protocol 
sequences, they may be switched, and the plurality of images 
displayed, based on the display protocol sequence switched to, 
on the display means. 

Further, the display protocol sequence can be set in 
advance, or it can be created based on the predetermined 
conditions when the images are displayed on the display means. 

As the "predetermined conditions" , the type of examination , 
the series, the examining doctor or the group of doctors the 
examining doctor belongs to, etc. may be employed. 

The image display apparatus of the present invention for 
displaying a plurality of images on a display means is provided 
with a memory means for remembering at least one display protocol 
sequence, in which a plurality of display protocols that define 
a display format are lined up in a predetermined order, and a 
control means for controlling the switching, based on at least 
one display protocol sequence, of display layouts by the 
switching of display protocols. 

For cases in which multiple display protocol sequences are 

remembered by the memory means of the display apparatus of the 

present invention, an input means is provided for receiving 

selection of a desired display protocol sequence. 

uT~^> That aforementioned control means displays, based on the 

/ \ 
C/^display protocol sequence selected in die input means, on the 

display means the plurality of images is desirable. 



In addition, that the control means of the display 
apparatus of the present invention can also switch the multiple 
display protocol sequences, and based on the display protocol 
switched to, display the plurality of images is desirable. 

Furthermore, that the control means of the image display 
apparatus according to the present invention creates the display 
protocol sequence based on the predetermined conditions, and 
displays the plurality of images on the display means based on 
the created display protocol sequence is desirable. 

Note that image display method of the present invention 
may be provided as a program that causes a computer to execute 
the image display method of the present invention recorded on 
a computer - readable storage medium. 

According to the present invention, based on a display 
protocol sequence in which a plurality of display protocols have 
been lined up in a predetermined order, the display layout of 
a plurality of images can be switched; therefore, it is not 
necessary for the examiner to memorize the display protocols, 
and the work load of the examiner is thereby reduced. 

Further, for cases in which there are multiple display 
protocol sequences, because a desired display protocol sequence 
can be selected, the degree of freedom with respect to image 
display format is raised. 

Additionally, for cases in which there is are multiple 
display protocol sequences, because the display protocol 
sequence can be switched, the examiner can display the plurality 
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of images according to a desired display protocol sequence. 
BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block drawing of the configuration of a 
medical image network, in which the display apparatus according 
to a preferred embodiment of the present invention is 
implemented, 

Figure 2 is a block diagram showing the detailed 
configuration of a workstation, 

~*?-r7jrrr^ ^ ^^nvL ft-Tn mnipInn of dicplav v r o t o e o ^rST" 
Figure 4 shows the display protocol sequence selection 
screen, and 

Figure 5 is a flowchart of the operation of a preferred 
embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
15 Hereinafter, with reference to the drawings , the preferred 

embodiments of the present invention will be explained. 

Figure \ is a block drawing of the configuration of a 




ijg I medical image network, in which the display apparatus according 
to a preferred embodiment of the present invention is implemented. 
2 0 As shown in Fig. l,\this medical image network comprises an image 
server 1 storing image data S and a workstation 2 connected 
by a network 3. In such a medical image network, by workstation 
2 accessing image serveAl and specifying that image data stored 
in image server 1 be transmitted, or by workstation 2 reading 
25 out from image server 1 imag^e data stored from workstation to 
mage server 1, images can be ^displayed at workstation 2 and 
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diagnosis performed. Wote that in Fig. 1, although only one 
workstation is shown, Viultiple workstation 2's are connected 
to image server 1 by network 3 . 

Image server 1 is provided with: a temporary storage medium 
11, such as a RAID (Redundant Array of Inexpensive Disks) , etc. 
for temporarily storing image data S; an archive disk 12 , such 
as a CD-R, DVD, DLI , etc. for providing semi - permanent storage 
of image data S after a specified period of time has elapsed; 
and a server computer 13 for controlling da ta - compression 
processing of image data S, data management, data transmission 
from workstation 2 , and various operations and processes of image 
server 1. Further, image server 1 is connected to an input 
modality 4 such as CR apparatus, CT apparatus, MRI apparatus, 
etc . , from which it receives formed image data S , which it stores 
and manages . 

Note that , Naccording to the set conditions (after a 
predetermined period of time elapses after diagnosis by a doctor 
has been performed, \for example) , image data S is copied from 
temporary storage meditim 11 to archive 12 . For example, when said 
set conditions are satisfied, the exact same image data S as that 
stored in temporary storage medium 11 is copied to archive 12, 
and as the amount of storage^ space on temporary storage medium 
11 becomes unavailable for use\ said image data S is deleted from 
temporary storage medium 11 in Vhe order commencing from the 
oldest date thereof, whereby saidV image data S becomes stored 
exclusively in archive 12. Note tha\ according to the purpose 



of image data S, it may be compressed and stored in both temporary- 
storage medium 11 and archive 12. In addition, original image 
data or original imageXdata that has been compressed and is 
extractable can be stored in temporary storage medium 11, and 
when said image data is cogpied to archive 12 it can be made 
undecompressible . 

Further, copying data S to archive 12 and deleting data 
S from temporary storage medium 11 are managed by the database 
DB, which is not shown in the drawings. Accordingly, if a request 
for image data S that has been deleted from temporary storage 
medium 11 is issued by display terminal 2, said image data is 
read out from archive 12 and transmitted to display terminal 2 . 
In this case, although more time is required for such reading 
out and transmitting from archive 12, compared to cases in which 
image data S is transmitted to display terminal 2 from temporary 
storage medium 11, the image represented by image data S can be 
displayed by display terminal 2 without recognition of the 
storage location of said image data S. 

Workstation 2 is provided with: a computer 21; a CRT, LCD, 
etc. monitor 22; and a keyboard, mouse, etc. input means 23. 
By various input operations of input means 23, image data S can 
be acquired from image server 1 and images displayed on monitor 
22 . 

Next, the image display method for displaying images on 
onitor 22 of workstation, 2 will be explained. Figure 2 is a 
block diagram showing the cietailed configuration of a 
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workstation. As sliown in Fig. 2, workstation 2 is provided with 
a controller 27 anld a memory 28. Note that in the current 
embodiment two monitors, 22A and 22B are used for displaying 
images. In addition, controller 27 and memory 28 are provided 
in Fig. 2 for explanation purposes , however; actual processing 
is carried out by use of software installed in computer 21. In 
memory 28, multiple di splayv protocol sequences PS, in which 
multiple display protocols P defining multiple display layouts 
are lined up in a predetermined^ order , are remembered. 

Fig. 3 shows the display layouts according to each type 
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)f display protqcol . Note that in the current embodiment, images 
obtained by a CTV apparatus are displayed. More specifically, 
in a CT apparatus! two images are taken of the same position: 
one of the images has shadowed structures, and the other image 
does not. Generally ,\ there is set of projection images (called 
"scout views") composed of a projection image having shadowing 
and a projection image\ not having shadowing, and a set of 
cross - sec tional images composed of a cross - sec tional image 
having shadowing and a cross - sec tional image not having 
shadowing, for a total of Vwo sets of images. Each of the two 
sets of images obtained in Vhis way are grouped so that there 
is a group containing an image SI (projection image with 
shadowing), and an image S2 (Gross - sectional image with 
shadowing) # and a group containing an image S3 (projection image 
without shadowing), and an image\s4 ( cross - sec tional image 
without shadowing) . Here, there i as only one image for each 
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projection image; however, each cross - sec tional image has 36 
images, corresponding Vo the slice position, which are 
represented by S2 and S4 .Vote that images SI - S4 represent images 
obtained in the current examination . 
5 In addition, the patient subjected to the current 

examination was subjected to an identical examination a week 
before (hereinafter referred to as a past examination) , and for 
the past examination, a group of images containing an image 01 
(projection image with shadowing), and an image 02 (cross- 
10 sectional image with shadowing) , and a group containing an image 
03 (projection image without shadowing) , and an image 04 
(cross - sectional image without shadowing) were obtained. The 
number of images is the same as for S1-S4. 

Furthermore, X-ray images of a front view and a side view 
of the chest of this patient were also obtained. 

First, the examining doctor performs a brief examination 
£gv<p /of the images obtained in the current examination. In this case, 
as shown in Fig. 3 (a)\ the display screen of monitors 22A and 
22B are each divided in\p 9 sections, and image S2 is displayed 
20 first, followed by image\s4 . Here, images S2 and S4 each have 

36 cross - sec tional images ,\however, because only 18 images can 

t- \ 

be displayed at one time on iftpnitors 22A and 22B, according to 
a switching operation of inpuAmeans 23, the displaying of all 
the images is split into two tiVes and carried out. This type 
25 of image protocol is , designated ^s PI 

Next, for cases ir^which images obtained in a past 
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examination aVe to be compared to images obtained in the current 
examination, trie display screen of monitors 2A and 22B are each 
divided into foir sections and each of the images are displayed: 
in region Al, image SI; in region A2 , image S2 ; in region S3, 
5 image Ol; in region A4 , image S4; in region Bl, image S3; in 
region B2 image E4'; in region B3 , image 03 ; and in region B4 , 
image 04. Here, image SI has only one image, but image S2, S4, 
02 and 04 each ha^ie 6 cross - sec tional images, therefore, by 
employing input mekns 23, the images are sent in order or in 

10 reverse order, according to the number assigned to each mage 
(generally, the slide order, in other words, the order of the 
slice position), and! switched and displayed. Further, a mark 
for showing what is dalled the referencing position of the 
cross - section is displayed in images SI, S4, Ol and 04 . In this 

15 way, it is possible to see which position of the cross - sec tional 
positions of images SI , S V , Ol and 04 is currently being displayed . 
This type of display layput is called a stack display, and by 
displaying such a stack display it is possible to compare image 
S2 to image 02 , and image S4\to image 04; that is to say, comparing 

20 the images obtained in tha past examination to the images 
obtained in the current examination is easy to perform. In 
addition, if switching of the images of the past examination 
and images of the present examination is carried out at the same 
time, by switching only the imaaes on one side, because the images 

25 on the other side are also sent\in order, it is easy to compare 
the images on both sides. This\type of image protocol is 



designated^as P2 . 

Next, when comparing the CT images and the chest X-ray 
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' - images, the display screen of monitor 2A is divided xnto four 
sections, and the\display screen of monitor 22B is divided into 
5 2 sections and eachUmage is displayed: on monitor 22A, in region 
Al, image SI; in region A2 , image S2 ; in region A3, image S3; 
in region A4 , image S V ; and on monitor 22B, in region Bl, the 
front view chest X-ray image; in region B2 , the side view chest 
X-ray image. This type o£ image protocol is designated as P3 . 

^ in ^ Display protocol PS1 is composed of aforementioned display 

P2\and P3, lined up in that order, display protocol 
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' (protocols PI, 

^ PS2 is composed oft aforementioned display protocols PI, P2 and 



P3, lined up in the\prder PI, P3, P2 , and display protocol PS3 
is composed of aforementioned display protocols PI, P2 and P3, 

15 lined up in the order F2, PI, P3 . 

Note that for such display protocol sequences PS, there 
is a selection screen displayed on monitors 22A and 22B as shown 
In Fig. 4, from which it is possible to select by clicking with 
the mouse, a desired display protocol sequence PS. Further, at 

20 this time, it is beneficial that the display protocol sequence 
be selected corresponding to the examination, the series, the 
type of input modality 4 in which the images were formed (CR 
images, CT images, MRI images, etc.), the examining doctor or 
group of doctors to which the examining doctor belongs (reading 

25 doctor, cl inical doctor , referring doctor, etc.) the place where 
the images are to be employed (an examination room, a doctor's 
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residence, etc.), the purpose for which the images are to be 
used, (reading, reference, comparison, etc.), etc. 

2Then,\by selecting the display protocol sequence from 
se type of aisplay protocol sequences, controller 27 displays 
images on v monit®rs 22A and 22B in the layout corresponding to 
the order of theXdisplay N protocol s in the selected display 
protocol sequencer 

Next, the operation of the current embodiment will be 
explained. Figure 5 is a flowchart of the operation of the current 
embodiment. First > the doctor who is the examiner of images on 
of workstation 2, using the input means 23, selects a display 
protocol sequence for use when images are displayed on monitors 
22A and 22B (Step SI) , and at the same time specifies that image 
server 1 transmit , the image data S to be displayed (Step S2). 
Note that in the current embodiment, the display protocol 
sequence PS1 selected is to be PS1 . Accordingly, image data S 
is transmitted by image server 1 over network 3 to workstation 
2 (Step S3) . When controller 27 receives transmission of image 
data S, the selected display protocol sequence is read out from 
memory 28, and at first, based on to the first display protocol 
PI, the layout is performed and the laid out images are displayed 
on monitors 22A and 22B. 

Next, oy pressing a function key, clicking on the screen 
ith the mouseXetc. a check is conducted (Step S5) to determine 
whether or not sVitching of the display protocol sequence has 
been specified, arrd if a yes is registered in Step S5, a check 



to determine wAether or not the current display protocol 
displaying the images is the last display protocol, P3, of the 
selected display Wotocol sequence PS1 (Step S7) . If a no is 
registered in Step , layout is performed using the next display 
protocol in order after PI, that is P2, and the images of the 
next layout are displayed on monitors 22A and 22B (Step 28) 
and Step S5 is returned to. 

Further, when the display protocol sequence is switched, 
layout is performed using the next display protocol, P3 , and 
the images of the next layout are displayed on monitors 22A and 
22B . 

— 7 On the\one hand, if a no is registered in Step S5, a check 

/ is conducted do determine whether or not switching of the display 
protocol has beW specified (Step S6) , and if a yes is registered 
in Step S6, the display protocol sequence is switched from the 
display protocol ssequence selected in Step SI, PS1, to the 
specified display pAotocol sequence ( PS2 , for example) , and Step 
4 is returned to; layout is performed using the first display 
protocol of the switched to display protocol sequence, and the 
images displayed. Note Vhat if a no is registered in Step S6, 
Step S5 is returned to aftd Steps S5 and S6 are repeated. 

In addition, if a yes is registered in Step S7, Step 4 is 
returned to and the images are laid out according to the first 
display protocol PI and displayed. In this way, each time 
switching of the display protocol is performed, the display 
protocols are switched in the order PI, P2, P3, PI, etc., and 
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the images laid out and displayed on monitors 22A and 22B. 

In this way, because in the current embodiment, based on 
display protocol sequence PS1, in which the plurality of display 
protocols PI, P2, and P3 are lined up in a predetermined order, 
5 the display format can be switched, the examiner of images at 
workstation 2, by performing only the simple operation of 
switching the display protocols in a simply defined sequence, 
can switch the display layout of images displayed on monitors 
22A and 22B. Accordingly, the examiner of images does not have 
10 to memorize the display protocols, and his or her workload is 
thereby reduced. 

•si w 

^ Further, for cases in which there are multiple display 

protocol sequences, because the display protocol sequence can 

^jJ be switched, the examiner of images can display the plurality 

*~ 15 of images according to a desired display protocol sequence. 

" Note that in the current embodiment, as shown in Fig. 3, 

the display layout of the images is switched using display 
protocols that define display layouts, however; display 
protocols may be defined for each type and level of multiple 
20 image processing processes, and the image display format changed 
according to display protocol sequences in which the multiple 
display protocols are lined up. For example, by using a display 

protocol sequence in which various display protocols for 

\ 

changing the intensity - level processing are lined up in a 
25 predetermined order, images having different intensity levels 
can be switched in order and displayed. 
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Further, in the current embodiment, the display protocol s 
are switched by specifying the switching, it is also possible, 
for example, that display protocols be switched every so many 
seconds, etc., or automatically. 

In addition, although in the current embodiment the 
display protocol sequence is selected in advance, the display 
sequence may also be created automatically corresponding to the 
examination, the series, the type of input modality 4 in which 
the images were formed (CR images, CT images, MRI images, etc.) , 
the examining doctor or group of doctors to which the examining 
doctor belongs (reading doctor, clinical doctor, referring 
doctor, etc.) the place where the images are to be employed (an 
examination room, a doctor's residence, etc.), the purpose for 
which the images are to be used, (reading, reference, comparison, 
etc.), etc. In this case, the display format is switched 
according to the generated display protocol sequence. 
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